Search results for "Replication crisis"

Statements About the Pervasiveness of Behavior Require Data About the Pervasiveness of Behavior

2020

Despite recent close attention to issues related to the reliability of psychological research (e.g., the replication crisis), issues of the validity of this research have not been considered to the same extent. This paper highlights an issue that calls into question the validity of the common research practice of studying samples of individuals, and using sample-based statistics to infer generalizations that are applied not only to the parent population, but to individuals. The lack of ergodicity in human data means that such generalizations are not justified. This problem is illustrated with respect to two common scenarios in psychological research that raise questions for the sorts of the…

An Agenda for Open Science in Communication

2021

Contains fulltext : 226720.pdf (Publisher’s version ) (Open Access) In the last 10 years, many canonical findings in the social sciences appear unreliable. This so-called "replication crisis" has spurred calls for open science practices, which aim to increase the reproducibility, replicability, and generalizability of findings. Communication research is subject to many of the same challenges that have caused low replicability in other fields. As a result, we propose an agenda for adopting open science practices in Communication, which includes the following seven suggestions: (1) publish materials, data, and code; (2) preregister studies and submit registered reports; (3) conduct replicatio…

Developing an open science mindset.

2022

Background: Identification of widespread biases present in reported research findings in many scientific disciplines, including psychology, such as failures to replicate and the likely extensive application of questionable research practices, has raised serious concerns over the reliability and trustworthiness of scientific research. This has led to the development of, and advocacy for, ‘open science’ practices, including data, materials, analysis, and output sharing, pre-registration of study predictions and analysis plans, and increased access to published research findings. Implementation of such practices has been enthusiastic in some quarters, but literacy in, and adoption of, these pr…

Always pay attention to which model of motor learning you are using

2022

This critical review considers the epistemological and historical background of the theoretical construct of motor learning for a more differentiated understanding. More than simply reflecting critically on the models that are used to solve problems—whether they are applied in therapy, physical education, or training practice—this review seeks to respond constructively to the recent discussion caused by the replication crisis in life sciences. To this end, an in-depth review of contemporary motor learning approaches is provided, with a pragmatism-oriented clarification of the researcher’s intentions on fundamentals (what?), subjects (for whom?), time intervals (when?), and purpose (for what…

Replication crisis or an opportunity to improve scientific production?

2020

Measuring Behavior in the Home Cage: Study Design, Applications, Challenges, and Perspectives

2021

Contains fulltext : 239279.pdf (Publisher’s version ) (Open Access) The reproducibility crisis (or replication crisis) in biomedical research is a particularly existential and under-addressed issue in the field of behavioral neuroscience, where, in spite of efforts to standardize testing and assay protocols, several known and unknown sources of confounding environmental factors add to variance. Human interference is a major contributor to variability both within and across laboratories, as well as novelty-induced anxiety. Attempts to reduce human interference and to measure more "natural" behaviors in subjects has led to the development of automated home-cage monitoring systems. These syste…

Human olfactory communication: current challenges and future prospects

2020

Although anthropologists frequently report the centrality of odours in the daily lives and cultural beliefs of many small-scale communities, Western scholars have historically considered the sense of smell as minimally involved in human communication. Here, we suggest that the origin and persistence of this latter view might be a consequence of the fact that most research is conducted on participants from Western societies who, collectively, were ratherold(adults),deodorizedanddesensitized(ODD) to various aspects of olfactory perception. The view is rapidly changing, however, and this themed issue provides a timely overview of the current state-of-the-art on human chemocommunication. Based …

P-Value, Confidence Intervals, and Statistical Inference: A New Dataset of Misinterpretation

2017

Statistical inference is essential for science since the twentieth century (Salsburg, 2001). Since it's introduction into science, the null hypothesis significance testing (NHST), in which the P-value serves as the index of “statistically significant,” is the most widely used statistical method in psychology (Sterling et al., 1995; Cumming et al., 2007), as well as other fields (Wasserstein and Lazar, 2016). However, surveys consistently showed that researchers in psychology may not able to interpret P-value and related statistical procedures correctly (Oakes, 1986; Haller and Krauss, 2002; Hoekstra et al., 2014; Badenes-Ribera et al., 2016). Even worse, these misinterpretations of P-value …